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ABSTRACT; 

A study is devoted to the development of statistical procedures 
to be used to test the validity of the Ships Supply Support Study simulator. 
Some theory is presented for each test procedure, but special emphasis is 
paid to describing each test in detail so that the tests can be implemented 
by the project study group. Examples which illustrate the required numerical 
work are given with each test procedure, and the advantages and disadvantages 
of each are pointed out. A computer program which will perform the calcu- 
lations necessary for the more complicated test is included. 

This test was supported by the Research and Development Division, 

Naval Supply Systems Command, under NAVSUP RDT&E No. TF 38.531.001. 
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1 . INTRODUCTION 



A problem associated with any simulation study is to test the 

results obtained from the simulator to determine how well the system 

being studied is duplicated. It is only after the simulation results 

have been validated that any reliance can be placed on the output of 

4 

that simulator. In the Ships Supply Support Study (S ) a simulator 
is used to obtain estimates of the mean supply response time (MSRT) 
for each of 13 material cognizance classes Ccogs). In addition, 
random samples of actual response times observed by ships in the 
fleet for each of the cogs have been collected. In order to validate 
the S^ simulation results the simulator MSRT's should be compared to 
the available data. Since cog response times are random variables 
with perhaps different distributions for each cog, statistical methods 
are desired to test whether or not the simulator MSRT's are indeed 
the same as the means of the actual cognizance class response times, 
the populations in this study. 

There are several well known statistical techniques which 
can be used to perform the above tests. This report describes briefly 
some of those tests and discusses some of the advantages and dis- 
advantages of each. Detailed instructions for implementing the tests 
are presented, and examples are given to illustrate the numerical 
work which must be done. 

Although the statistical tests are developed and described 
4 

with reference to S , they should also be useful for validating 



future simulations. 
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2. NOTATION 



The following standard notation will be used in describing 

the statistical tests in this report. Let n^ be the number of 

actual ship observations of supply response time for cog i. Then, 

th 

let be the j observation of supply response time for 

cog i; i = 1, 2, ,,,, 13 and j = 1 , 2 , . . , , n^ . Let 



and 



n. 



X. = y X. . / n. 
1 . ij 1 



j=l 




(n.-l) , 



the sample means and sample variances, respectively, for cog i. 

The value will denote the actual (unknown) population mean 

supply response time for cog i, and will represent the value 

4 

obtained from the S simulator for the MSRT of cog i. 



3. A SINGLE TEST FOR THE MULTIPLE HYPOTHESIS TESTING PROBLEM 
3 . 1 BACKGROUND 

4 

It is desirable to validate the S simulator by testing 
whether or not each simulator MSRT approximates the population MSRT. 
In this section, a single test is derived which will validate or 
invalidate the entire set of simulator MSRT’s. Thus, it offers a 
computational advantage of requiring few calculations. 

Consider the hypothesis testing problem: 



H : 
0 


•H 

II 


i = 


1, 2 




Pi f \ 


for 


some 
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H is the null hypothesis, and it simply states that each of the 
o 

simulator MSRT's is the actual mean of the population of the respec- 
tive cog response time. The alternative hypothesis, states that 

some simulator MSRT is not the population MSRT. If each of the 
sample sizes n^^, n^, n^^ is sufficiently large (50 or more), 

this hypothesis testing problem does not require any assumptions 
about the underlying populations of the supply response times other 
than requiring that the populations have finite first and second 
moments. This is important because little work has been done in 
determining the properties of the response time distributions. 



3.2 DERIVATION OF THE TEST STATISTIC 



With fairly large sample sizes the central limit theorem 

indicates that the distribution of each is approximately 

2 

normal with mean U ^ and variance / n^, regardless of the 

population distribution. Thus, 




is approximately chi-square distributed with one degree of freedom, 
denoted Furthermore, the X^'s are independent so that 



i=l 

2 

is chi-square distributed with 13 degrees of freedom, X (13). 

2 

For the statistical problem at hand the population variance O^, 
like the population mean, is unknown. To circumvent this problem 
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the sample variance is substituted for the population variance 

2 

This substitution should not be serious if the sample sizes are 
large. 

When the null hypothesis is true; that is, ~ 

i, the distribution of 



13 (X.-X.) n. 
D= I - ^ ^ ^ 



i=l 






1 

will be approximately chi-square with 13 degrees of freedom. On 

calculating a value of D based on the observations in a random 

sample, the value should not be large if the null hypothesis is true. 

2 

To be more precise, let X (13) represent that unique number such 

QL 

that the probability that an observation of a random variable having 

a distribution which is chi-square with 13 degrees of freedom exceeds 
2 

X^(13) is a. Then, if the null hypothesis is true, an observed 

2 

value of D would exceed the value Xq^( 13) with a probability of 

a. If a is small, it is an unlikely event that a value of D 
2 

exceeds X (13). The statistician is led to believe that H is 

o 

false whenever such an event occurs. 



3.3 DESCRIPTION OF THE TEST PROCEDURE 

The test procedure reduces to an especially simple comparison 

2 

of the calculated value of D with the number Xq^(13) • 

(1) Determine the maximum probability that one is willing 
to reject H when H is in fact true. Denote 
this probability, the level of significance of the test, 
by a. 
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(2) Determine the number Xq^C 13) from standard chi-square 
tables. 

(3) Calculate a value of D based on the observed random 
samples . 

2 

(4) If the value of D exceeds the number Y (13) reject H . 
3.4 DETERMINING THE POWER OF THE STATISTICAL TEST 



When the level of significance, a, is chosen the probability 
of rejecting the null hypothesis when it is true is determined-* it 
is also useful to determine the probability of rejecting the null 
hypothesis when it is false, the power of the test. Suppose ^ 

and for at least one value of i, 6. ^ X . . The random variable D 
is now distributed as a non-central chi-square random variable with 
13 d.f. and non-centrality parameter 



-i 



6.-X .)^ 
1 1 



Tables for the non-central chi-square distribution can be used to 
determine the probability of rejecting H^ when the alternative 
= 6^; for i = 1, 2, ..., 13 is true. The test procedure is 
known to have the desirable property that the probability of re- 
jecting H^ when it is false is greater than a; that is, H^ is 
more likely to be rejected when it is false than when it is true. 



3.5 EXAMPLE 

For brevity, suppose that the number of cogs is three and 
let the following table give the values determined from the random 



6 



samples and the simulator. 



i 










1 


20 


16 


48 


21 


2 


32 


4 


48 


32 


3 


24 


16 


48 


26 



TABLE 1 



The hypothesis being tested is: 

Hq; P2 = ^2' ^3 "" ^3 

vs 

^l’ ^1 ^ ^1’ or \i or ^ X^ 

2 

Let the level of significance be .05. The number x found 

from chi-square tables to be 7.815. The value of the test statistic 
D calculated from the given values is: 

B = . 15 

16 4 16 

2 

Since the value of the test statistic D exceeds the value X q 5^^^ 
the null hypothesis is rejected at a .05 level of significance. 



3.6 DISADVANTAGES OF TEST 1 

The example points out two disadvantages of this test. When 
the test statistic rejects the null hypothesis, nothing is revealed 
about the validity of the individual simulator values. It is pro- 
bably true that some of the simulator values are sufficiently accurate 

even when the null hypothesis is rejected. In fact, the data in the 

— 2 

above example shows that ^2 ” ^2 ^2 small, so that the 

simulator value for cog 2 is obviously good. It seems desirable 
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that the statistical procedure not only test the hypothesis, but also 
locate those cogs on which further work need be done. 

Another disadvantage revealed by the example is that each of 
the simulator values is within ten percent of the sample means, but 
the null hypothesis is rejected. Since a ten percent error is pro- 
bably a tolerable amount as far as validating the simulator, perhaps 
the hypothesis should be stated as: 

(1-p) ^ ^ Cl+p) i = 1, 2, 13 

vs 

^ (1“P) X^ or y^^ ^ (1+p) X^ some i 

where 0 ^ p ^ 1 is a permissible fraction of error. The second 
statistical test considers such a null hypothesis. 



4. INDIVIDUAL STATISTICAL TESTS FOR COMPOSITE TWO-SIDED HYPOTHESES. 
4.1 BACKGROUND 



Two disadvantages of the first test procedure were pointed 
out. The test developed in this section eliminates both of those 
disadvantages. Consider testing each cog, individually. A test 
statistic will be derived for each cog, and individual values of 
cog MSRT are either validated or invalidated. Let k be any one 
of the 13 cogs. The statistical hypothesis tested in this section 
is : 



H : 
o 



»r 



VS 



\ ^ •'k ^ % 
or 
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For S applications 6j^ and ^ would probably be taken to be 
(l^p) and Cl+p) respectively. This tests the hypothesis 

that the true mean differs from the simulated mean by no more than 
a fraction p. 

Although attention is restricted to a single cog at a time, 
the fact that the statistical hypotheses are two-sided and composite 
complicates the problem. Nevertheless, a test can be derived which 
has **optimal" properties. Lehmann [2] has shown that the test which 
will be developed is the uniformly most powerful unbiased test of 
size a. It is by this criterion that the test is considered best. 

4.2 DESCRIPTION OF THE TEST 

Since the distributions of the populations are unknown, it is 
necessary to assume that the sample sizes are sufficiently large so 
that the sample variances can be substituted for the unknown popu- 
lation variances in the test procedure. The large sample sizes are 
also needed to justify appealing to the central limit theorem to 
take the distribution of to be normal with mean and variance 

^’k ' "k- 

Let be that subset of the sample space containing all of 

those points , • • • >X^) such that their sample mean X is 

either greater than a constant L^ or less than a constant U^; i.e., 



The uniformly most powerful unbiased test of size a has a particularly 
simple form with the set as the rejection region. Thus, if 






X ) I X < L, or X > U, } . 
n ' k k 
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is in the set reject Otherwise, accept Hence, all 

that remains to specify completely the best test is to find the 

values of the constants L, and U, . These are determined from the 

k k 

conditions which state that the probabilities of rejecting when 

= Cl-p) and = (1+p) must both be a in order that the 
test be unbiased of level a. That is, 

P[X^ <L^ or 3^ > I = (1-p) X^] = a 



and 

4.2.1 P[Xj^ < or I = (1+p) X^] = a 

Since the distribution of X, is symmetric and y, is a location 

xC K. 

parameter for that distribution, it is easily shown that 

and Because the problem reduces to 

finding the single constant only one of the probability state- 

ments is necessary. Thus, for a given level a equation 4.2.1 can 
be used to uniquely determine C^. 

By standardizing the random variable (using in 

place of equation 4.2.1 can be replaced by the equivalent 

statement : 



4.2.2 



-S-P \ ^ 2 ^ V 









= 1 



a. 



where Z is standard normal random variable, N(0,1). Let 
F(y)=P[Z^y], p Xj^ / and . 

To determine the constant or equivalently the constant b^, 

the zero of the equation; 



4.2.3 
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must be determined. Some one dimensional search procedure 
to find that value since an explicit solution is unknown, 
in many cases the search is unnecessary for is 

zero. When this is the case, standard normal distribution 
be used to look up the value of b^^ such that 



4.2.4 



= 1 - cx. 



is needed 
Fortunately, 
approximately 
tables can 



4.3 OUTLINE OF PROCEDURE 

1. Choose a level a and a fraction p and calculate 

X^, and a^ for each cog k. 

2. Using the standard normal distribution tables find 
the value of bj^ such that F(bj^-a^) = 1 - a. 

3. Calculate F(--bj^-aj^) . If this value is sufficiently 

small (.0005 should be small enough), take to 

be the value determined in step 2 and proceed to 
step 6. 

4. If F(-b^-aj^) > 0.0005, choose a new value bj^ > b^^. 

5. If the value of > 1 - CX 

decrease b^ and try again. If the value is less 
than 1 - a increase b^ and repeat this step. 

6. When the value of FCb^-a^^) - F(-b^-aj^) = 1 - a, C^ 
Is thsn b,; /ynj. - X,, - abd = X^ + C^. 

7. If or reject Otherwise 

accept 
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4.4 EXAMPLES 

A. 1. Test the hypothesis that the mean supply response 

time for cog 1 is within 10% of the simulator MSRT. 



H : 0.90 A, ^ 1.10 A, 

o 11 1 

vs 

^ 1 * ^1 ^1 ^1 ^ ^1 
Let the level of significance be a = ,05. The sample 
mean and the sample standard deviation based on a 
random sample of size 100 are found to be = 38 
and = 5. The simulator MSRT is A^ = 35 and 
a^ is calculated to be 7 . 

2, From the standard normal tables find b^ 7 = 1.645 
and thus b^ = 8.645. 

3, Since b^ + a^ = 15.645 no iterative search need be 
made; = 4.3225, L^ = 30.6775 and = 39.3225. 

4, Since X^ is in the interval [30.6775, 39.3225] the 
null hypothesis is not rejected. 



B. 1. Test the same hypothesis as above, but suppose the 

mean and standard deviation calculated from a 
random sample of size 36 are X^ = 38 and = 35. 
Let the simulator MSRT still be A^ = 35 and calculate 
a^ to be 0.60. 

From standard normal tables find b^ “ 0.60 = 1.645, 
and thus b^ = 2,245. 



2 . 
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3. Since F(-bj^-a^) = .00225, choose a new value b| > b^^. 

Suppose the new value is b| = 2.280. 

4. The value of F(bj-'aj^) - FC-bj-a^^) = F(1.680) - F(-2.880) = 

0.9535 - 0.0020 = 0.9515 which is now larger than 1 - a. 

Choose a new value b| < 2.280, say b| = 2.265. 

5. The value of FCbj^-a^^) - F(-b|-aj^) is now 0.9520 - 0.0021 
= .9499, or within .0001 of the value of 1 - a, and 

the iterative search is terminated. 

6. Calculate C^^ = 13.21, = 21.79 and = 48.21. 

7. Since is in the interval [21.79, 48.21] the null 

hypothesis is not rejected. 

Examples A and B illustrate the simple procedures which must be 
followed in order to test the hypothesis that the true population mean is 
within a given percentage of the simulator MSRT^s. For the data which 
is to be tested in the Ships Supply Support Study it would probably rarely 
be necessary to perform an iterative search for the constants C^. In 
example B, the sample standard deviation was forced to be unrealistically 
large in order to present a case where a search was necessary. Even if 
a search were necessary, a trial and error procedure by hand quickly zeros 
in on the solution. 

4.5 AN EXTENSION OF TEST 2 

Whenever the null hypothesis stating that the population mean supply 
response time is within a given percentage of the simulator MSRT is rejected, 
it seems desirable to know how poor is the simulator value. The test con- 
sidered in this section can be used to provide additional information 
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when the hypothesis is rejected. Instead of stating only that the hypo- 
thesis is rejected at a given level for a given value of p , we can also 
determine the smallest value of p for which the hypothesis would be 
accepted at the given level. For example, it may be the case that the 
hypothesis stating that the population mean supply response time is within 
10% of the simulator MSRT at the ,05 level is rejected, but the hypothesis 
would be accepted at the same level if p were 0.15. The magnitude of 
the minimum value of p needed to accept the null hypothesis should pro- 
vide some information as to the amount of additional work needed, if any, 
to be satisfied that the simulator is generating reasonable numbers. 



4.6 DETERMINING THE MINIMUM VALUE OF p 

We have seen that the null hypothesis is accepted at a given level 
a provided that ^ k ” ^ ^ ^ ^ k ^k’ where depends on the 

value of p. We use this to determine the minimum value of p needed in 
order that the acceptance interval contain the number X^. 

1. Take C, to be the absolute value of the difference 
k 

between A and X^; that is, 









2. Determine b^ = ^k\/^^^k* 

3. Since p is unknown, must be determined iteratively. 

As an initial trial take ” ^k “ 

4. Calculate this value is, say, less than 

0.0005, the minimum value of p is 



= 






min 
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If the value of F(-bj^-aj^) is too large to be neglected, 
the value of aj^ must be determined by using an iterative 
search just as the value of bj^ was determined previously. 
5. If F(-bj^-aj^) > 0.0005, choose a new value aj^' 

If F(bj^-a^') - F(-bj^-aj^*) < 1 - a decrease and try 

again. If the value is greater than 1 - a increase a^' 
and repeat this step. 

When is such that F(bj^-aj^') - F(-bj^-aj^') = 1 - a, 



6 , 



The following example illustrates the above calculations. Let us 
find the minimum value of p which will cause the null h}rpothesis 

Ho- - h ■ P^l^ ^1^- ^l''' P^l 

to be accepted at a .05 level of significance where = 35. The sample 
mean and sample standard deviation based on a sample of size 100 are 
= 41 and = 5. We find that “ I ~ 35 1 = 6 and b^^ = 

C, ,/n7 / S, =12. For the initial trial we take a, = b, - Z = 12.0 - 
1.645 = 10.355. Since ~ “22.355, F(-bj^-a^) is negligible, and 

we take to be 10.355. The minimum value of p for which the null 

hypothesis is accepted is therefore 



. (10. , 355 >i5 ) . . 
f^mln (10) (35) 

As with the search for in the hypothesis testing problem 

with the given value of p an iterative search will rarely be necessary 
in the above procedure. In almost all problems of practical interest a^ 
will be approximately b^ - since F(-a^-b^) will be negligible. 
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4.7 THE COMPUTER PROGRAM 

Although the calculations needed to carry out the tests in this 
section are quite simple and a trial and error search usually zeros in 
very rapidly on the values of or a^^, it may not be feasible to 

perform a large number of tests manually. For that reason a computer 
program utilizing a first-order Newton search, whenever a search is ne- 
cessary, is included as Appendix A. The program only requires the user 
to input the number of tests, a value for p, the significance level, and 
a tolerable error which is used to terminate the search. (An error of 
0.0005 was used in the examples.) In addition, the user must input the 
sample size, the sample mean, the sample standard deviation, and the 
simulator MSRT for each cog. The comment cards in the program should make 
the program self explanatory. 

For each cog the program determines the lower and upper limits of 
the acceptance region for the given value of p, and it tells if the hypo- 
thesis is accepted or rejected. If an hypothesis is rejected the program 
gives the minimum value of p necessary to accept the hypothesis. Included 
with the program in Appendix A is a set of sample input and sample output. 

5. SUMMARY AND CONCLUSIONS 

Two tests have been investigated for use in testing the validity 
4 

of the S simulator. The single assumption necessary for the procedures 

to be valid seems easily justified based on the sample data which was 

available. Both of the tests presented are quite simple and could easily 

4 

be performed by the group at FMSO or some other member of the S team in 
only a few hours. 
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Because of the disadvantages of Test 1 which were pointed out in 
Section 3,5, Test 2 is recommended. Theoretically, it is the best test 
possible for testing the given hjrpothesis, and the included computer pro- 
gram will perform a large number of tests in a few seconds. A caution 
should be pointed out concerning the choice of p for Test 2. When 
choosing a value for p, one should be aware that he is essentially 

declaring a tolerable error for the simulation values. It is necessary 

4 

that the effects of such errors on any conclusions arrived at by S be 

examined. If the effects are severe p must be small. 

It is the author's intent that this report be useful as a working 

4 

paper for performing the needed tests for S and perhaps also for future 
studies , 
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APPENDIX A 



C C 

C VALIDATION TESTS FOR SSSS SIMULATOR C 

C FIRST-ORDER NEWTON SEARCH IS USED WHEN NEEDED C 

C C 

Q * * ;(c 4: :(c 4c itc 4c ^ 4c *! 4: :4c :4c A * ’tc 4c * * 3(1 ** 3)c # * :4c 4 : ^ :$c :4c 4c * :4c :4c ^ :fc:ic 9^ :4c :4c :4c 3^ ;«c * :4c :4c * ;(c Q 

C C 

C DEFINITION OF VARIABLES C 

C C 

C4c4c 4c4c 4c 4c 4c4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c4( 4c 4c 4c 4c 4c 4: 4c 4: 4c 4c 4c4c 4c 4c 4c 4c 4c 4c4( 4c 4c 4c4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4cC 



C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 



NTEST 

ALPHA 

P 

ZALPHA 

ERROR 



) 



AN( I ) 
XBAR( I 
S( I ) 
SMEAN( I ) 
PMIN 

L 

U 



NUMBER OF TESTS TO BE MADE 
SIGNIFICANCE LEVEL OF THE TESTS 
FRACTION OF ERROR FOR THE TESTS 
VALUE FROM NORMAL TABLES SUCH THAT 
P( Z > ZALPHA ) = ALPHA 
ERROR TOLERANCE. THE ITERATIVE SEARCH 
WILL TERMINATE ONLY IF 

ABS(F(B-A) - F(-B-A) - (1-ALPHA)) < ERROR 
SIZE OF SAMPLE I 



MEAN OF SAMPLE I 
STANDARD DEVIATION 
SIMULATOR MEAN FOR 
MINIMUM VALUE OF P 
I S ACCEPTED 
LOWER LIMIT OF THE 
UPPER LIMIT OF THE 



OF SAMPLE 
COG I 
FOR WHICH 

ACCEPTANCE 

ACCEPTANCE 



HYPOTHESIS 

REGION 

REGION 



C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 



d; 4c 4c 4c4= 4c 4c 4c 4c 4: 4: 4c 4c 4c 4c 4c 4c 4c 4: A 4c 4c 4c 4c 4: 4: 4c 4c 4c 4c 4c 4c 4c 4c 4c4c 4c 4c 4c 4c 4e 4c4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4c 4( 4c 4c 4c 4: Q 

DOUBLE PRECISION IDEC1.IDEC2 
DATA IDECl/' ACCEPT '/,IDEC2/' REJECT •/ 

DIMENSION AN(20), S(20), XBAR(20), SMEAN(20) 

QAAAAAAAA4- AAA A A* AAA AA ♦*★****♦***♦♦♦*♦ AAA* AAAA A A*AAAAA*AAA**C 



C 

C 

C 

C 

c 

c 



READ INPUT 

READ NO. OF TESTSt ALPHA. P, ZALPHA, AND ERROR 
READ SAMPLE S I ZE , XBAR , STD . DEV., AND SIMULATOR 
EACH TEST. 



MEAN FOR 



C 

C 

c 

c 

c 

c 



CAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC 
RE ADI 5, 1 ) NTEST .ALPHA, P, ZALPHA, ERROR 
1 FORMAT! I5,F5.3,3F10.5) 

READ(5,3) (AN( I),XBAR( I),S( D.SMEANCI), 1=1, NTEST) 

3 FORMAT! 8F10.0) 

QAAAAA AAAA AAA AAAAAAA A A AAA AA AAAAAAAAA AAA AAAAAA AAAAAAAAAAAA A AC 
C C 

C SET UP OUTPUT TABLE C 

C C 

CAA AAAA:ic4cAAAAAAAAAAAAAAAA AAA AAAAAA AAAAAAAAAAAAAAA4 cAAAAAAAAAC 
WRITEI6.55) ALPHA, P 

55 FORMAT! ‘O' ,6X, 'AAAAa VALIDATION TESTS*' 
1,i4caaa* ,///, • HYPOTHESIS TESTED: !l-P)LAMBDA < MU' 

2,' < ! 1+P)LAMBDA ', //,5X, 'LEVEL OF S I GNI F I C ANCE= ', 



3F5.3.5X, 'P=',F6.3,///) 
WRITE!6,50) 

50 F0RMAT!3X,58!1H-)) 
WRITE!6,51 ) 



51 F0RMATI3X,' 
1' XBAR 



I 



U 



N I DECISION I L 
PMIN I ' ,/,3X,58! 1H-) ) 

CAAAAAAA AA AAAAAAAAA AAAAA AAAAAAAAAAAAAAAAA AAAA AAAAAAAAAAAAAAC 
C C 
C BEGIN CALCULATIONS FOR TESTS 1 THROUGH NTEST C 
C C 



CAA AAAAAAAAAAAAAAAAA AAAAA AAAAA AAAA A AAAAAA AAAA AAAAAAAAAAAAAAC 
DO 40 K=l, NTEST 
ROOTN = SORT! AN !K) ) 

A = P A SMEANIK) A ROOTN / S!K) 

B = ZALPHA + A 
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IFLAG = 0 
2 XI = B - A 
X2 = -B - A 

CALL NDTR(X1,CDF1, PDFl ) 

IF(X2.GE. -^.0) GO TO 23 
CDF2 = 0.0 
PDF2 = 0.0 
GO TO 33 

23 CALL NDTR(X2,CDF2»PDF2) 

33 FX = CDFl - CDF2 - (1.0 - ALPHA) 

IF( IFLAG. EO.O) GO TO 34 

^♦* ♦*♦♦♦♦<« ♦*♦****♦♦♦♦#*♦*****♦♦♦♦**♦♦**♦**♦** 

c c 

C CAN WE TERMINATE THE SEARCH ON A? C 

C C 

IF(ABS( FX) .LT. ERROR) GO TO 17 

c c 

C CONTINUE ITERATIVE SEARCH C 

C . C 

C*****:«cjkj)(*j(£**:Sc***:^t*******jMt***#************i|t***Jtt**:(t********0 

FPRIME = PDF2 - PDFl 
A = A - FX/FPRIME 
GO TO 2 

C###*#*«:«c4:A*«*#*:«c:(c*#*****3Mc#***4:******3K**«4c#***«*********#*C 
C C 

C CAN WE TERMINATE THE SEARCH ON B? C 

C C 

C4c***4:*«4ci«c**4c*****3»:*«****«4:*««*#**^*4c«**:«‘***«#3«c**********«:«‘C 

34 IF( ABS( FX) .LT. ERROR) GO TO 7 

******* ********ii^^**********^il‘*^*^^*****C 
C C 

C CONTINUE ITERATIVE SEARCH C 

C C 

Q**:(t*:tt#**ije:(c***j((j(t**:4t**j}t****^#j(t*:<t******#**************;*****#*C 

FPRIME = PDFl * PDF2 
B = B - FX/FPRIME 
GO TO 2 

***#♦*### #***:(!# *:)c*:i(c:te******* + ***:i(c**3tE*****C 

C C 

C DETERMINE ACCEPTANCE INTERVAL C 

C C 

C**********************************************************C 
7 C = B ♦ S(K) / ROOTN 
XMAX = SMEANIK ) + C 
XMIN = SMEAN(K) - C 

C**i*i*i******************************************************Q 

c c 

C IS XBAR INSIDE THE ACCEPTANCE INTERVAL? C 

C C 

C** ♦♦★♦**♦♦♦♦*#*♦♦****♦***«*♦**♦!{= ♦♦♦♦******54=***************C 
IF(XBAR{K).GT. XMAX. OR. XBAR(K).LT. XMIN) GO TO 9 

Q*# j)£j(tj(t*j(E******* ♦sit :([*:([ 

C C 

C YES. ACCEPT HYPOTHESIS AND WRITE ANSWERS C 

C C 

CHc*iict***ti‘*************************************************C 
WRITE(6,6) K.IDECl, XMIN, XMAX. XBAR(K) 



6 F0RMAT(3X. • I » 



13. - 
I • ) 



,A8. 



F9.3. • I • ,F9.3, ' 



1F9.3.' I 

GO TO 40 

C#**i{c* #♦***:):*♦**♦#♦♦*♦♦***♦*********♦♦♦♦***♦♦:<£♦**♦*♦♦♦♦♦♦ **0 

C C 

C NO. REJECT HYPOTHESIS AND DETERMINE PMI N C 

C C 

9 C = ABS(SMEAN(K) - XBAR(K)) 

B = C * ROOTN / S(K) 

A = B - ZALPHA 
IFLAG = 1 
GO TO 2 



19 



C *********** *******:(!#*****3)E******:(::(t**3jt**j(:3{c:)tj)e4t *♦♦♦♦**♦♦* 

C C 

C CALCULATE PMIN AND WRITE ANSWERS C 

C C 

17 PMIN = A * S(K) / (ROOTN * SMEAN(K)) 

WRITEI6.18) K, IDEC2t XMIN. 



wr\iic:iOfXO# rvt lu c\^ ^ t An i in • 

18 FORMATOXt* I * tI3,' I ',A8,' | 

lF9.3t ' I • tF6.3, • I • ) 

40 CONTINUE 
WRITE! 6,50) 

STOP 

END 



XMAX, XBAR(K), PMIN 
, F9.3,' 1•,F9.3,* I 



C****»3(!3(!*******3)t3«e***3!e*3(t5)eJ(t**3(t***J|t****3(t****3tt*3tt****5)e******3tt***C 

C C 

C SUBROUTINE TO CALCULATE CDF AND PDF FROM NORMAL DIST. C 
C C 

Q9fe34c3k34c3^3§c:^)tt 4e ^:fc39e:l^?i)c3((:(e39e:4cate34e3$c99e3^39o4ea9e34e:^39e99ca4eC 



SUBROUTINE NDTR(X,P,D) 

AX=ABS(X) 

T=1.0/(l .0 + .2316419*AX) 

D=0.3989423*EXPI-X*X/2.0) 

P= 1.0 - D*T*( ( I ( 1.330274*T - 1 . 82 12 56) ’f'T + 1.781478) 

1 *T - 0.3565638)*T + 0.3193815) 

IF(X) 1,2,2 

1 P=1.0-P 

2 RETURN 
END 

C C 

C DATA C 

C C 

Q :(( Jfc :{( # )(C 3k :(c 3tc 4c 4c >)c 3(C :(c 3^ 3k 3tc 3^ 3^ )(C 3tc 3^ 3<c 4= ^ 3): ^ 4c 3^ ^ * 4c ^ :4c 3): * 34: C 

n DATA 

6 0.05 0.1 1.645 0.0001 

100.0 48.55 12.32 36.00 75.0 63.21 

12.0 35.6 64.33 11.33 49.0 36.0 

147. 42.0 9.3 57.0 196. 48. 



non noon 
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VALIDATION TESTS FOR SSSS SIMULATOR. 

USES FIRST ORDER NEWTON SEARCH WHEN SEARCH IS NEEDED 

DOUBLE PRECISION IDEC1,IDEC2 
DATA IDECl/' ACCEPT '/,IDEC2/' REJECT •/ 

DIMENSION AN(20), S(20), XBARI 20) » SMEANI20) 

READ NO. OF TESTS, ALPHA, P, ZALPHA, AND ERROR 

REA0(5,1 ) NTEST, ALPHA, P, ZALPHA, ERROR 

1 FORMAT! I 5.F5.3 ,3F10.5) 

C 

C READ SAMPLE S I ZE , X BAR , STD . DEV., AND SIMULATOR MEAN FOR 
C EACH TEST. 

READ(5,3) (AN(I),XBAR(I),S(I),SMEAN(I) , 1=1, NTEST) 

3 FORMAT (8F10.0) 

WRITE(6,55) ALPHA, P 

55 FORMAT ( 'O' ,6X, ****** VALIDATION TESTS*' 
1 , I****' ,///, • HYPOTHESIS TESTED: (l-P)LAMBDA < MU' 

2,' < ( 1+P)LAM3DA' , //,5X, 'LEVEL OF SI GNI F I C ANCE = ', 
3F5.3,5X, *P=' ,F6.3,///) 

WRITE(6,50) 

50 FORMAT! 3X, 58( IH- ) ) 

WRITE!6,51 ) 

51 FCRMAT!3X,'| N I DECISION | L I U IX 

1 ' PMIN I ' ,/, 3X, 58! 1H-) ) 

DO 40 K=l, NTEST 
ROOTN = SORT! AN! K) ) 

A = P ♦ SMEAN!K) * ROOTN / S!K) 

B = ZALPHA + A 
IFLAG = 0 

2 XI = B - A 
X2 = -B - A 

CALL NOTR! X1,:0F1,PDF1) 

IF!X2.GE. -4.3 ) GO TO 23 
CDF2 = 0.0 
PDF2 = 0.0 
GO TO 33 

23 CALL NDTR!X2,CDF2,PDF2 ) 

33 FX = CDFl - C0F2 - !1.0 - ALPHA) 

IF! IFLAG. EO.O) GO TO 34 
IF!ABS!FX).LT. ERROR) GO TO 17 
FPRIME = PDF2 - PDFl 

A = A - FX/FPRIME 
GO TO 2 

34 IF!ABS! FX) .LT.ERROR) GO TO 7 
FPRIME = PDFl + PDF2 

B = B - FX/FPRIME 
GO TO 2 

7 C = B * S!K) / ROOTN 
XMAX = SMEANIK) + C 
XMIN = SMEANIK) - C 

IF!XBAR!K) .GT.XMAX.OR.XBAR!K).LT.XMIN) GO TO 9 
WRITE!6,6) K, IDECl, XMIN, XMAX, XBARIK) 

6 FORMAT! 3X, ' I ' , I 3, ' I ',A8,' I', F9.3,' |',F9.3,' I', 
1F9.3,' I I ' ) 

GO TO 40 

9 C = ABS!SMEAN!K) - XBAR!K)) 

B = C * ROOTN / S!K) 

A = B - ZALPHA 
IFLAG = 1 
GO TO 2 

17 PMIN = A * S!K) / IROOTN ♦ SMEANIK)) 

WRITE!6,18) K, IDEC2, XMIN, XMAX, XBARIK), PMIN 

18 F0RMATI3X,' I ' ,13, ' I ',A8,' (', F9.3, ' |',F9.3,' I', 

1F9.3,' I*,F6.3,' I') 

40 CONTINUE 
WRITE!6,50) 

STOP 

END 
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SUBROUTINE NDTR(X,P,D) 

AX=ABS( X) 

T = 1.0/ (1 .0 + .2316419*AX) 

D=0.3989423*EXP(-X*X/2.0) 

P= 1.0 - D*T4( ( ( ( 1.330274*=T - 1.821256)*T + 1.781478) 
1 *T - 0.3565638)*T + 0.3193815) 

IF(X) 1,2,2 

1 P=1.0-P 

2 RETURN 



END 



# DATA 



6 0.05 0.1 

100.0 48.55 

12.0 35.6 

147. 42.0 



1 .645 

12.32 

64.33 
9.3 



0.0001 

36.00 

11.33 



75.0 

49.0 
196. 



63.21 

36.0 

48. 



***** VALIDATION TESTS ***** 



HYPOTHESIS TESTED: (l-P)LAMBDA < MU < (1+P)LAMBDA 

LEVEL OF SIGNIFICANCE =0.050 P = 0.100 



N 


DECISION 


L 


u 


XBAR 


PMIN 


1 


REJECT 


30.373 


41.627 


48.550 


0. 292 


2 


ACCEPT 


54.222 


70.438 


63.210 




3 


ACCEPT 


-25.135 


47.795 


35.600 




4 


REJECT - 


18.390 


25.610 


36.000 


0.572 


5 


REJECT 


50.038 


63.962 


42.000 


0.241 


6 


ACCEPT , 

j 


40.648 

L 


51.352 


48.000 
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